Expected Patch Log Likelihood with a Sparse Prior
نویسندگان
چکیده
Image priors are of great importance in image restoration tasks. These problems can be addressed by decomposing the degraded image into overlapping patches, treating the patches individually and averaging them back together. Recently, the Expected Patch Log Likelihood (EPLL) method has been introduced, arguing that the chosen model should be enforced on the final reconstructed image patches. In the context of a Gaussian Mixture Model (GMM), this idea has been shown to lead to state-of-the-art results in image denoising and debluring. In this paper we combine the EPLL with a sparse-representation prior. Our derivation leads to a close yet extended variant of the popular K-SVD image denoising algorithm, where in order to effectively maximize the EPLL the denoising process should be iterated. This concept lies at the core of the K-SVD formulation, but has not been addressed before due the need to set different denoising thresholds in the successive sparse coding stages. We present a method that intrinsically determines these thresholds in order to improve the image estimate. Our results show a notable improvement over K-SVD in image denoising and inpainting, achieving comparable performance to that of EPLL with GMM in denoising.
منابع مشابه
The student-t mixture as a natural image patch prior with application to image compression
Recent results have shown that Gaussian mixture models (GMMs) are remarkably good at density modeling of natural image patches, especially given their simplicity. In terms of log likelihood on real-valued data they are comparable with the best performing techniques published, easily outperforming more advanced ones, such as deep belief networks. They can be applied to various image processing t...
متن کاملPatch-based image reconstruction for PET using prior-image derived dictionaries.
In PET image reconstruction, regularization is often needed to reduce the noise in the resulting images. Patch-based image processing techniques have recently been successfully used for regularization in medical image reconstruction through a penalized likelihood framework. Re-parameterization within reconstruction is another powerful regularization technique in which the object in the scanner ...
متن کاملImage restoration with generalized Gaussian mixture model patch priors
Patch priors have became an important component of image restoration. A powerful approach in this category of restoration algorithms is the popular Expected Patch Log-likelihood (EPLL) algorithm. EPLL uses a Gaussian mixture model (GMM) prior learned on clean image patches as a way to regularize degraded patches. In this paper, we show that a generalized Gaussian mixture model (GGMM) captures t...
متن کاملBayesian Approaches to the Problem of Sparse Tables in Log- Linear Modeling
This paper presents Bayesian approaches to parameter estimation in the log-linear analysis of sparse frequency tables. The proposed methods overcome the non-estimability problems that may occur when applying maximum likelihood estimation. A crucial point when using Bayesian methods is the specification of the prior distributions for the model parameters. We discuss the various possible priors a...
متن کاملGray-box Inference for Structured Gaussian Process Models: Supplementary Material
1 Proof of Theorem 2 Here we proof the result that we can estimate the expected log likelihood and its gradients using expectations over low-dimensional Gaussians, that is that Theorem. For the structured gp model defined in our paper the expected log likelihood over the given variational distribution and its gradients can be estimated using expectations over Tn-dimensional Gaussians and |V|-di...
متن کامل